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@ Coded modulation with unequal error protection. 

@ Digital signals (from 101), such as digital television signals, are subjected to a source coding step (by 
104) followed by a channel mapping step (by. 114 and 115). The source coding step causes the signal to 
be represented by first and second data streams (on 105, 106). The first stream carries data regarded as 
more Important and the second canies data regarded as less ImportanL In the channel mapping step, 
the mapping Is such thai the data elements of the various data streams have differing probabilities of 
being enoneously detected at the receiver. The channel mapping step includes at least one multilevel 
coding step. The signal constellations used In the channel mapping step are partitioned into 
supersymbols, in which the distance between the symbols comprising at least ones of the supereymbols 
is less than a parameter refened to as the maximum intra-subset distance (MID). Additionally, in some 
constellations, the minimum distance between at least ones of the symbols of at least one of the 
supersymbols is greater than the minimum distance between the symbols of the constellation as a 
whole while, again, still being less than the MID. The first data stream is used to identify a sequence of 
supersymbols, whRe the second data stream is used to select particular symbols from the identified 
supersymbols. 
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It is generally acknowledged that some form of digital transmission will be required for the next aeneration 
of telev.s on technology, conventionally referred to as high definition television, or HDW This requi^l^, 
due mostly to he fact that much more powerful video compression schemes can be lm^en«nted w 'h dta t^ 
signal processing than with analog signa processino However th<.™ ha. h.- 'mpiemeniea with digital 

ception. Whereas reception for the otherWs;;i'^rbT.f^^^^^^^^^^^ 

.n performance over short distances is generally not considered acceptaWe by thTbroad^sro Indult^^^^ 
cc^^panspthedegradatloninperforman^^ 

™r " '"""'""J'*" f "'9"^' '^"'""'"ion scheme adaptable for use in television applications which over- 
comes this problem. Solutions used in other digital transmission environments-such as thf^e oTa) reoet 

iadltl^^^^^^^^ 

■ alrbraadcIsSordoair 
air broadcasting of digital TV signals- referred to herein generically as "unequal-error-protection sionallno'- 

. comprises a particular type of source coding step followed by a particular type of chann^awKeP More 

while, in the channel mapping step, the mapping is such that the data elements oftha various data sSea^ 
t7he receTf Tffl °' channe.-induced error. i.e.. different probabilities of being erZ^Z^l^ 
mII r ""^ t'"'- ' °' Oaia streams carries co^Unents of he ove aM 

l d t e vi^roo.rn cnr'^f'^"''!."'"'''"''"'^"'"^^^ 

and the v tal potions of the video informatlon^-and that data stream is mapped such that its data elements 
have the lowest probability of channel-Induced error. A second one of the data streams ca rtes compo^enS 

tha data tream mapped such that its data elements have a probabaity of channel-induced error that is not 

a ! numblrrdJi .!r« " T"'' \" " " ""^'""^ '° -9" ' v^"^ 

lh=hr^ , data steams, each carrying components of varying unportance and each having a respective 
probabaity of error. This approach allows a graceful degradation In reception quality at the TV set locaUon be- 

Se fir^t to braUSed *" 

In a scheme which implements the above-described overall concept in which different levels of error pr«^ 
tection are provided for different classes of data elements generated by the source enclosing step, but which 
provides enhanced noise irnmunity via the use of coded modulation, such as trellis-coded modulation, the sym- 
bols in a predetermined 2N-dimensional channel symbol constellation, N S 1. are divided into groups, eachof 

ber of the most important data elements are channel encoded, and the resulting channel coded data elements 
Klentrfy a particular one of the supersymbols. The remaining data elements, which may also be channel en- 
coded, are used to select for transmission a particular symbol from the (denlVied supersymbol 

in that he latter also divide the channel symbols into groups, typically referred to as 'subsets." However In 
convent»nal coded modulation schemes, the subsets are formed under the constraint that the minimum Eu- 
didean distance (hereinafter referred to as the "minimum distance") between the symbols in a subset is greater 
than the minimum distance between the symbols in the constellation as a whole. In the described approach 
however, the minimum distance between the symbols or a supersymbol Is the same as the minimum distance 
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between the symbols in the constellation as a whole. This distance property allows for greater amount of noise 
immunity for the most important data elements than for the other data elements, that immunity being optimized 
by keeping the minimum distance between supersymbols as large as possible-rusually greater than the mini- 
mum distance between the symbols of the constellation. Specifically, once the supersymbols are defined, it 
5 is possible to design codes for the most important data elements based on the distances between the super- 
symbols, i.e., as though each supersymbol were a conventional symbol In a conventional constellation. This 
being so. a particular degree of noise immunity can be achieved for the most important data elements that is 
greater than what can be achieved for the other data elements. 

10 Summary of the Invention 

The present invention provides the designer of unequaUerror-protectlon signaling schemes of the above- 
described type with additional flexibility. In accordance with the invention, so-called multi-level coding is used 
to code the data elements of at least one of the data streams that are Input to the channel mapping step. For 

f 5 example, multi-level coding can be used to code the data elements which ultimately determine the supersym- 
bol selection. Alternatively, it may be used'to code the data elements which determine the selection of a par- 
ticular symbol from within a selected supersymbol. Or multi-level coding can be used for both streams. The 
particular way in which the multi-level coding Is used will depend on the requirements of any particular appli- 
cation in terms of the degree of error protection desired to be afforded to any particular dass of the data being 

20 coded. 

There are at least two important advantages to this approach. One is that it provides an enhanced flexibility 
In designing a channel coding to realize a desired percentage of the overall data stream being coded that is 
to be regarded, and treated, as most Important. Another advantage Is that It provides an enchanced flexibility 
in apportioning Jhe available redundancy between the most Important data and the less important data, there- 
25 by providing a mechanism for achieving particular desired different levels of error protection for those two 
classes of data. A yet further advantage is that this approach allows differential levels of protection to be af- 
forded to substreams of data elements within any of the streams |hat are multi-level coded In accordance with 
the invention. 

Multi-level coding perse Is a technique already known in the prior art. In accordance with that technique. 

30 data elements to be coded are divided into two or more substreams. Each of one or more of the substreams 
is then individually redundancy coded using a code of any desired type. The individual encoded substreams- 
•along with any substreams that were leftuncoded-form the output of the multi-level code. That output is then 
used In the prior art to identify channel symbols of a predetermined consteHallon for transmission over a chan- 
nel. However, the prior art does not encompass the teaching, lying at the heart of the present Invention, that 

35 multi-level coding can be advantageously used to code one or more of the data streams of an overall unequal- 
error-protection signaling scheme. 

Advantageously, particular desired combinations of a) coding gain for the most important data elements, 
b) coding gain for the less important data elements, and c) percentage of most important data elements are 
more readily achievable by incorporating one or more multi-level codes In anunequal-error-prolectlon signaling 

<o scheme in accordance with the invention, than when single-level codes are used. From the coding theory 
standpoint, this result can be understood as arising out of the fact that the invention allows the redundancy 
Introduced into the overall coding scheme to be allocated in virtually any desired proportion between the coding 
of the most important data elements and coding of the less Important data elements. 

45 Brief Description of the Drawing 

FIG. 1 1s a block diagram of a transmitter embodying the principles of the invention; 
FIG. 2 is a block diagram of a receiver for signals transmitted by the transmitter of FIG. 1; 
FIG. 3 depicts a prior art signal constellation; 
50 FIG. 4 depicts a signal constellation illustratively used by the transmitter of FIG. 1; 

FIGS. 5 and 6 show illustrative multMevel coders used In the transmitter of FIG. 1 1n accordance with the 
invention; 

FIG. 7 depicts a signal constellation that can alternatively be used by the transmitter of FIG. 1; 
FIG. 8 depicts a signal constellation of the type typically used in equal error protection schemes; 
55 FIGS. 9-14 depict further signal constellations that can alternathrely be used by the transmitter of FIG. 1; 

and 

FIGS. 15 and 16 show Illustrative multi-stage decodes used in the receiver. of FIG. 2 in accordance with 
the invention. 
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Dotailed Dascriplion 

Before proceeding with a description of the Illustrative embodiments, it shotjid be noted that various ones 
of the digital signaliqg concepts described herein are all well known in. for example, the digital radio and voi- 

s ceband data transmission (modem) arts and thus need not be described In detail herein. These include such 
concepts as multidimensional signaling using 2N-dimenslonal channel symbol constellations, where N Is some 
.nteger, trellis coding: scrambling: passband shaping: equallzaUon: Vltertil. or maximum-likelihood, decoding- 
e c These concepts are described in such U.S. patents as U.S. 3.810.021. issued May 7. 1974 to 1 Kalet et 
al.: U.S. 4.015.222. issued March 29. 1977 to J. Werner; U.S. 4,170.764. Issued October 9 1979 to j SaS e 

10 al.; U.S. 4.247.940. issued January 27. 1981 to K. H. Mueller et al.: U.S. 4.304.962. Issued December s 1981 
to R D. Fracassi el al.; U.S. 4.457,004. issued June 26. 1984 to A. Geraho et al.: U.S. 4.489 418 issued De- 

^^.klt^ i*i ''•520.«0. fesued May 28. 1985 to L. Wei; and U.S. 4.597.090, issued 

June 24, 1986 to 6. 0. Forney, Jr. 

It may also be noted before proceeding that various signal leads shown In the FIGS, may carry analog 

IS signals, serial bits or psfaHel bits, as will be clear from the context 

Turning now to FIG. 1, television (TV) signal source 101 generates an analog video signal representing 
picture information or -Intelligence.- which signal Is passed on to source encoder 104. The latter generates a 
d gital signal comprised of data elements in which atleast one subset of the data elements represents a portion 
of the information, or Intelligence, that Is more Important than the portion of the Information, or Intelligence 

io represented by the rest of the data elements. Illustratively, each data element is a data. bit. with an average 
m+k information bits being generated for each of a succession of symbol intervals. The symbol Intervals are 
comprised of N signaling intervals, where 2N is the number of dimensions of the constellation (as described 
below) The signaling intervals have duration of T seconds and. accordingly, the symbol Intervals each have 
a duration of NT seconds. The embodiments explicitly disclosed herein happen to use two-dimensional con- 

25 stellations, i.e., N = 1. For those embodiments, then, the signaling Intervals and the symbol Intervals are the 
same.. 

Of the aforementioned m-^k information bits, the bits within the stream of m bits per symbol interval ap- 
on^ead 106^ """'^ ''"P^''*^"* ^^^"^ bits within the stream of k bits per symbol Interval, appearing 

The bits on leads 105 and 106 are independently scrambled in scramblers 110 and 111 , which respectively 
output m and k parallel bits on leads 112 and 1 1 3. (Scrambling Is customarily carried out on a serial bit stream 
Thus although not explicitly shown in FIG. 1. scramblers 110 and 111 may be assumed to perform a parallel- 
to-senal conversion on their respective input bits prior to scrambling and a serial. to-parallel conversion at their 
outputs.) The signal is then channel mapped. In particular, the respective groups of bits on leads 112 and 113 
are extended to channel encoders 114 and 115 which generate, for each symbol interval, respective expanded 
groups of r and p bits on leads 121 and 122, where r > m and p > k. The values of those bits Jointly identify a 
particular channel symbol of a predetermined constellation of channel symbols (such as the constellation of 
FIG. 4 as described In detail hereinbeiow). Complex plane coordinates of the Identified channel symbol are 
output by constellation mapper 131. illustratiyely realized as a lookup table or as a straightforward combination 
of logic elements. Conventional pass-band shaping and television modulation are then performed by passband 
shaper 141 and television modulator 151. respectively. The resultant analog signal is then broadcast via an- 
tenna 152 over a communication channel, in this case a free-space channel. 

In order to understand the theoretical underpinnings of the Invention, it will be useful at this point to digress 
to a consideration of FIG. 3. The latter depicts a standard two-dimensional data transmission constellation of 
the type conventionally used in digital radio and voiceband data transmission systems. In this standard 
scheme-conventionally referred to as quadrature-amplitude modulation (QAM)..data words each comprised 
of four information bits are each mapped into one of 16 possible two-dimensional channel symbols. Each chan- 
nel symbol has an in-phase. or I, coordinate on the horizontal axis and has a quadrature-phase, or Q. coordinate 
on the vertical axis. On each axis, the channel symbol coordinates are ± 1 or ± 3 so that the distance between 
each symbol and each of the symbols that are horizontally or vertically adjacent to it is the same for all symbols 
-that distance being "2". As a result of this uniform spacing, essentially the same amount of noise immunity 
Is provided for all four information bits. 

As is well known, it Is possible to provide improved noise immunity without sacrificing bandwidth efficiency 
(information bits per sipnaiing interval) using a coded modulation approach in which an 'expanded" two-di- 
mensional constellation having more than (In this example) 16 symbols is used In conjunction with a trellis or 
other channel code. For example, one can use a 32-symbol. two-dimensional constellation together with an 
e-state trellis code to achieve approximately 4 dB of enhanced noise immunity over the uncoded case of FIG. 
3. while still providing for the transmission of four Information bits per signaling Interval. Here. loo. however. 
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essentially Ihe same amount of noise Immunity is provided for all four information bits. 

Moreover, it is known liiat the known noise immunity and bandwidth efficiency advantages of coded mod- 
uialion are achieved while providing different levels of protection against channel-Induced error for different 
classes of bits. Specifically, it is possible to achieve a level of error protection for a dass of most important 
bits which is substantially greater than whatcan be achieved with the aforementioned conventional coded mod- 
ulation approach. Indeed, the transmitter of FIG. 1 embodies thai concept, as wBI now be described In further 
detail. 

The constellation used In the transmitter of FIG. 1 1s fllustratively the two-dimensional 32-symboI constel- 
lation shown in FIG. 4, The symbols in the signal constellatton are divided Into groups referred to as "super- 
symbols." Specifically, the constellat'ion of FIG, 4 is divided Into 2' = 2^ = 4 supersymbols. In this example, the 
points in the four quadrants constitute respective supersymbols, as denoted by a box enclosing each group. 
The supersymbols are denoted generically as n^^^^ where 64 = 0,1 and bj = 0,t The four supersymbols are 
thus fJoo. ^01, 0,0, and n,i. 

In this example, m = 1.625 and k = 2.125 so that the overall bit rate is 3.75 bits per symbol with 43.33% 
of the bits being In the class of most important bits. (The manner In which such fractional average bit rates 
can be achieved in practice will become clear as this description continues.) Encoder 114 adds an average 
0.375 redundant bits for every 1 .625 bits that are input to encoder 114 so that r = 2. Encoder 1 1 5 adds an aver- 
age 0.875 redundant bits for every 2.125 bits that are input to encoder 115 so that p = 3. The r = 2 bits on lead 
121 identify one of the four supersymbols and the p = 3 symbols on lead 122 select a particular one of the 
eight channel symbols within the identified supersymbol. The partitioning of the constellation Is such that the 
minimum distance between the synibois of a supersymbol-thal distance being denoted as di in FIG. 4~is the 
same as the minimum distance between the symbols in the constellation as a whole. Given this characteristic. 
Increased noise immunity for the most important bits can be provided via appropriate selection of a) the codes 
implemented by encoders 114 and 115 and b) the ratio cf,/d;i-where d, Is the minimum distance between the 
supersymbols. (The parameter d, is given by the minlmurii of the distances between ail the pairs of supersym- 
bols, with the distance between any pair of supersymbols being the minimum distance between any symbol 
of one of the pair of supersymbols and any symbol of the other.) 

Specifically, a coded modulation scheme can now be constructed for the most important bits as though 
the four supersymbols were four conventional symbols in a conventional constellation. To design such a coded 
tifiodulatlon scheme, the four supersymbols are partitioned, as is conventional, into a predetermined number 
of subsets. In this case, there are two subsets, where the value of 63 denotes which subset each of the su- 
persymbols belongs to. Thus, one subset, referred to as subset "0", comprises supersymbols Hoq and O,o and 
the other, referred to as subset "1", comprises sppersymbols Oqi and On. An appropriate code is used to en- 
code the most important Input bits to generate a stream of coded output bits which a) define a sequence of 
these subsets and b) for each subset of the sequence, select a particular supersymbol within that subseL The 
less important bits are then used to select for transmission a particular symbol from each of the thus-selected 
supersymbols. In this example, as already seen, this latter selection also involves the use of coded modulation. 

^[n accordance wit hjthej)resent invention, at least one of the channel encoders implements a multi-level 
code. In this exarfiple, in particu!ar7"66tlforthem do. As noted earlier, a multi-level code is one In which the 
data elements-in this embodiment, bils-to be coded are divided Into two or more substreams. Each of one 
or more of the substreams is then individually redundancy coded using a code of any desired type. The indi- 
vidual encoded substreams-along with any substreams that were left uncoded-form the output of the multi- 
level code. 

Particular illustrative embodiments for encoders 114 and 115 are shown in FIGS. 5 and 6, respectively. 
Encoder 114 implements a two-level code and, as such, includes two coders-cotiers 1141 and 1142. The re- 
dundancy code implemented by coder 1141 Is a conventional rale R = 7/8 zero-sum parity check code such 
as shown in G. C. Clark, Jr. and J. B. Cain. Error-Correction Coding for Digital Communications New York: 
Plenum, 1981). The redundancy code implemented by coder 1142 Is a conventional rale R = 3/4 punctured 
convolulional code such as shown in Y. Yasuda et al, "High-rate punctured convolutional codes for soft decision 
Viterbi decoding." IEEE Trans. Comm. . Vol. COM-32, 1984, pp. 315-318. In operation, a serial-to-parallel (S/P) 
.converter 1144 within encoder 114 takes In 13 bits over 8 symbol intervals, yielding an average input bit rate 
of m =1.625 bits per symbol interval as noted earlier. The output of converter 1144 comprises two substreams 
of bits. In one substream, the bits are provided in parallel groups of seven to coder^1l41 . In the other substream, 
the bits are provided In parallel groups of six to coder 1142, For every group of seven input bits, coder 1141 
generates eight output bits which are applied to 8-bit buffer 11 47. Al the same time, for every group of six Input 
bits, coder 1142generates eight output bits which are applied to 8-bil buffer 1148. The contents of buffers 1147 
and 1148 are read out synchronously in such a way that a pair of blls-one friom each of the two buffers-is 
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provided on lead 121 for each symbol interval. These bits are the aforementioned bits 6, and 64. As such the 
former identifies one of the two subsets -Q- and "r and the other identifies one of the two supersymbols from 
the Identified subset, the two bits b, and b, thus identifying one of the four supersymbols Opo. Oou n,o and 
"it* . u. 

..cf ""^^"^^'I? Implements a three-level code and. as such, includes coders 1151. 1152 and 1153. Coders 
51 and 1152 implement the same codes that are implemented by coders 1141 and 1142. respectively. Coder 
1153 implements a rate R = 1/2 convolutlonal code such as shown in the aforementioned Clark and Cain text 
In operation a seriaMo-parallel (S/P) converter 1 154 takes in 17 bits over 8 symbol intervals, yielding an aver- 
age inputbitrate of k = 2.125 bits per symbol interval, as noted earlier. The output of converter 1154 comprises 
hree substreams of bits. In one substream. the bits are provided in parallel groups of seven to coder 1151 In 
the second stream, the bits are provided in parallel groups of six to coder 1152. In the third group, the bits are 

!!!hl '1 ^^l^^''''^ "^'^ ^'^'^ ^"'"P '"P"^ 1151 generates 

eigh output b. s which are applied to 8-bit buffer 1157. For every group of six input bits, coder 1152 generates 

eigh ou pu bite which are applied to 8-bit buffer 1158. For ev 
eight output bits which are applied to 8-bit buffer 1159, 

The contents of buffers 1157. 1158 and 1159 are read, out synchronously in such a way that three bits-, 
one from each of the three buffers-are provided on lead 122 for each symbol Interval. These three bits^ 
denoted 6,. b, and bo- select a particular symbol from the supersymbol Identified at the output of encoder 
114. To this end. each of the symbols in the constellation Is labelled with a Ihree-bit label as shown In FIG 4 
These three bits are. in fact, the aforementioned bite 62. 6, and bo- 

The symbols of each supersymbol are partitioned at a first level of partitioning Into two subsete. Each sut>. 
set IS comprised of four symbols as denoted by the labelled b, value. Thus one subset Is comprised of the four 
symbols deno ed 000. 010. 100 and 110 and the other subset is comprised of the four symbols denoted 001 . 
Oil. 101 and 11 . The symbols of each of these subsete are partitioned at a second level of partitioning into 
two second-level subsets, which are identified by their labelled bo and b, values. Each second-level subset is 
compnsed of two symbols identified by bj, . 
^ The assignment of three-bit labels to the symbols of each supereymbol is not arbitrary. Rather, the codes 
implemented by coders 1151, 1152 and 1153 are selected taking into account the minimum distance between 
the subsete at each level of partitioning. In particular, the most powerful, i.e.. lowest-rate, code-in this case 
the rate R = 1/2 code implemented by coder 1153-is used at the first level of partitioning to generate bo be- 
cause the minimum distance between the subsete at the first level is the smallest, that distance being The 
second- and least-powerful codes, the rate R = 3/4 and rale R = 7/8 codes Implemented by coders 1152 and 
1151. respectively, generate b^ and 62. respectively, because the minimum distance between the second-level 
subsets is greater by a factor of >/2 than that of the first level minimum distance whereas the minimum distance 
between the symbols in each second-level subset is greater by a factor of 2 than (he first-level minimum dis- 
tance. 

The advantages provided by such use of multi-level codes In an unequal error protection signaling scheme 
are discussed hereinbelow. First, however, reference is made to the receiver of FIG. 2. 

In particular, the analog broadcast signal is received by antenna 201 ; subjected to conventional television 
front-end processing in processing unit 211 including, for example, demodulation: and converted to digital form 
by A/D converter 212. The signal is then equalized by passband channel equalizer 221. which generates a 
signal representing the equalizer's best estimate as to the I and Q component values of the transmitted symbol. 
This estimate, which is referred to hereinbelow as the -received symbol signal,- is passed on parallel rails 222 
and 223 to be channel decoded by channel decoders 231 and 232. The function of channel decoder 231 is to 
Identify the most likely sequence of supersymbols. while the function of channel decoder 232 is to identify the 
most likely sequence of symbols, given that sequence of supersymbols. The output of decoder 232 on lead 
234 thus comprises the bite 63 and b*. while the output of decoder 231 on lead 233 thus comprises the bite 
bo. b, and 63. 

Since the sfreams of most-important and less-lmportant bite are. In ihte embodiment, both multi-level cod- 
ed, the channel decoders 231 and 232 must each be multHevel decoders. Straightforward maximum likelihood 
decoding, such as a Viterbi decoding, could be employed for this purpose. However, the present Illustrative 
embodiment uses a more refined approach to multi-level decodlng-an approach referred to as multi-stage de- 
coding. This is a well-known technique, the details of which can be found In A. R. Calderbank. 'MuIlOevel codes 
and multistage decoding.- IEEE Trans. Comm.. Vol. COM-37, pp. 222-29. 1989. hereby Incorporated by refer- 
ence. For present purposes, then, it suffices to summarize. In overview, how the multt-stage decoding Is car- 
ned out 

In particular, channel decoder 232 first recovers the bite encoded by coder 1142 within encoder 114 (FIG. 
5). independent of. and without reference to. any decoding performed on the bite encoded by coder 1141. To 
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this end. as shown in FIG. 15, decoder 232 Includes decode circuitry 2321. decode 64 circuitry 2323 and 
delay element 2322. In operation, the received symbol signal is processed by circuitry 2321 to decode bit 63 
by first finding the symbol closest to the received signal symbol-and the associated metrics-In (Oq, v Hti) 
and in (Ooo v Oto)- The trellis path is then extended as per conventional Viterbi decoding of the code imple- 
5 mented by coder 1142 (FIG. 5) to generate a final decision about a previously encoded information bit that 
was encoded by that coder. The decoded bit-one of the original most important bits-is provided as an output 
on lead 234. It is also re-encoded within circuitry 2321 using the code of coder 1142 to provide bit to circuitry 
2323 as well as to channel decoder 231 (FIG. 16), as described below, via lead 236. A version of the received 
symbol signal Is delayed by delay element 2322 by a time sufficient to provide the value of bit b, as just de- 
10 scribed. That signal Is then provided to circuitry 2323 along with bit b, to circuitry 2323 which then proceeds 
to decode bit b^. This is carried out, In particular, by first finding the symbol closest to the received signal sym- 
bol-and the associated metrics~ln supersymbol Dob, and in supersymbol Clyt,. The metrics are stored in a buf- 
fer and are used to perform maximum likelihood decoding of the code implemented by clear 1141 (FIG. 5), 
thereby to provide another of the most important bits on lead 234. At the same time, that bit is re-encoded 
within circuitry 2323 to provide bit 64 to channel decoder 231 on lead 236. 

It may be noted at this point that, obviously, circuitries 2321 and 2323 must be provided within Information 
about the constellation that Is being used In order to carry out their respective functions. That information is 
illustratively stored in a constellation store 2325 whose output-denoted as "A'-ls provided to both of those 
circuitries, as well as to decoder 231 of FIG. 1 6. 

With the most important bits now provided on leads 234 and the values of bits 63 and 64 now being provided 
to decoder 231 on lead 236, the multi-stage decoding can now .proceed-within the latter channel decoder- 
to recover the less important bits. To this end, as shown In FIG. 16, decoder 231 includes decode b© circuitry 
2315. decode b, circuitry 2316, decode bj circuitry 2317. and delay elements 2311, 2312 and 2313. In oper- 
ation, the received symbol signal is delayed by an amount equal to the processing delay within decoder 232 
so that circuitry 12315 can be provided with bits and 64 at the same time that it receives the received symbol 
signal. Circuitry 2315 then proceeds by first finding, within the supersymbol n^^ft^, those symbols having bg = 
0 and bi - 1 which are respectively closest to the received signal symbol. The trellis path is then extended, 
as before, using the metrics associated with those two closest symbols, leading ultimately to a decoding of bit 
bo and hence a recovery of one of the less Important bits. That bit is then re-encoded within circuitry 2315 so 
as to be able to provide the value of bit bo to circuitries 2316 and 2317. The latter operate in a manner similar 
to that described above with respect to the other decode circuitries to recover the other less important bits, 
with the delays of delay elements 2312 and 2313 being sufficient to enable each of the circuitries 2316 and 
2317 to receive the re-encoded bits, as needed. 

Decoding In the case where muttl-dimensional symbols are used is carried out In a similar manner, as will 
be appreciated by those skilled in the art. 

The bits output by decoder 231 and 232 on leads 233 and 234, respectively, are descrambled by descram- 
biers 241 and242. which respectively perform the inverse function of scramblers 110 and 111 In the transmitter. 
A television signal formatted so as to be dlsplayable by an appropriate television set is then generated from 
^ the descrambler outputs by source decoder 253, thereby recovering the original television information, or in- 
telligence. That signal is then presented to the television viewer on television set'260. 

The performance of the overall unequal error protection signaling scheme implemented by the system of 
FIGS. 1 and 2, as just described, can now be characterized In terms of the nominal coding gain (I.e., the coding 
gain at very low error rates), this being the gain in signal-to-notse ratio over thatof an uncoded 16-QAM system. 
The gain for the most important bits is 6.24 dB and for the less important bits is 2.70 dB when the number of 
states of each of the convolutional codes is chosen to be 16. The unique advanta^ge of the present invention, 
however, does not wholly lie with the particular levels of coding gain achieved. Coding arrangements known 
in the prior art may achieve comparable, or even better, coding gain results in particular applications. However, 
where the invention is particularly advantageous is in its ability to provide the system designer with a greatly 
^ enhanced capability to pick the desired performance criteria, given the application, and to then readily arrive 
at a coding scheme which meets those criteria. 

For example, the overall data rate of the above-described system can be increased from 3.75 to 3.875 
bits per symbol without affecting the coding gain by changing the code Implemented by coders 1 141 and 11 51 
to a rate R » 15/16 zero-sum parity check code (and using 16-bIt. rather than B-.bit, buffers in the encoders). 
(At the same time, the percentage of most Important bits Increases ever so slightly- from 43.33% to 43.55%.) 
As another example, the percentage of most important bits can be reduced to 34.375%, while at the same 
time increasing the level of error protection afforded to those bits by a) changing the codes implemented by 
coders 1141, 1142, 1152 and 1153, to respectively, a rate R = 7/8 punctured convolutional code; a rate R = 3/4 
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convolu lonal code; a rate R = 7/8 zero-sum parity check code; and a rale R = 3/4 convolutional code- and M 
ehmtnating coder 1151 so that the bits applied to buffer 1157 are uncoded bits. This a^ngelm a^^^^^^^^^^ 

thlratifr.!^. 

tus be «1 \ Ik" \r fr ''''' ^"'"^ "^^^ ^'"P^^^^"* '^^^ important bits. It w1 

h«?.L . ^l" "'^ of a virtually unlimited range of design parameters-Jnciuding 

tion of the most Importan b.ts (as opposed to that used for the less important bits)-ln order to meet desired 
fndudT.o cl^^^^^^^ This flexibility can be further enhanced by using various different signal cons el at^s 

and subsetpartitionrngslndeedanew class 

em designer wi h even further flexibility. These constellations are characterized by particular distance rela- 

iTtltTn t This parameter Is the minimum distance between any two symbols in 

lte2onVh?H^^^^^ modulation schemes which, unlike In the present invention, seek to provide equal error 
protection the design constraint Is to partition the constellation into subsets in such a way as to maximize Z 
n^n^umof the intra-subset distances taken across an the subset 

LZnrn7.H ^ ^"^^r P^^^'^"'^^ '^"^'^^ "taking any other symboMo-subset 
assignment changes) would not result in a further Increase in the aforesaid minimum value 

n..I"rh«M" ITTal ?K '7*'°" P'^'""^" ""^^"^ P^'ectlon schemes 

needs to be kept In mind In the former, the error protection for the s<^called coded bits is determined by the 
minimum distance between subset sequences while the error protection for the uncoded bits is determined 
by the minimum distance between the symbols within a subset Designers of equal-error-protectlon schemes 
fnr". *° as dose to sach other as possible because they want equal error protection 

for an the data. The performance of these schemes is dominated by the distance between the symbols within 
a subset This results from the fact that one can always Increase the complexity of thb code in order to achieve 
whatever distance Is desired between subset sequences. 

In the case of unequal error protection, by contrast, the symbols in a supersymbol are selected by the 
less important bits. Thus the distance between these symbols can be significantly less than the MID. Indeed 
It is limited only by the distance between the symbols of the constellation as a whole. This distance Is chosen 
to provide the necessary level of error protection for the less important bits. Once we fix that distance, then 
the subset partitioning can be done to take advantage of this fact, thus making possible the realization of great- 
er distances between the supersymbol sequences than would be possible with conventional coded modulation 
for the same complexity. We are. thus, no longer constrained to keep the symbols within a supersymbol far 
35 away from each Other. *^ yinuui .ai 

Taking the foregoing Into account, constellations useful in unequal-error-protection signaling schemes are 
charactenzed by the fact that the minimum distance between at least some of the symbols of at least one of 
the supersymbols is less than the MID, Indeed, constellations of this general type are known. However In the 
prior art. the minimum distance between the symbols of the supersymbols is the same as the minimum dis- 
tance between the symbols of the constellation as a whole. By contrast, the constellations In question are not 
so constramed. That Is. the minimum distance between at least ones of the symbols of at least one of the su- 
persymbols IS greater than the minimum distance between the symbols of the constellation as a whole while 
again. stBI being less than the MID. Graphically speaking, constellations meeting this criterion wilt generally 
appear to have IMPef^yinbolswhl^^^ do the subsets of the constellations 

used for equal error>rotection schemes). That is. at least one symbol of a least one supersymbol will be doser 
to each of a pair of symbols of a different supersymbol than that pair of symbols are to each other. 

One illustrative. 32-symbol. constellation embodying these prindples is shown In FIG. 7. This constellation 
IS partitioned into four supersymbols. the constituent symbols thereof being labelled A. B C and D respec- 
lively. The distance labelled as -X" can be, for example. 'V, thereby providing a constellation whose Individual 
so symbols are uniformly spaced. Or -X" can be greater than one-such as VS-thereby increasing some of the 
inter-supersymbol distances. This provides an additional degree of design freedom in terms of achieving par- 
ticular desired levels of error protection. 

The MID of the constellation of FIG. 7 Is -2'. which dan be verified from a consideration of FIG. 8. In which 
the same constellation has been partitioned in order to provide equal error protection. That is, the minimum 
distance between any two symbols labelled 'A*, for example, is. In fact. -2". In FIG. 7. by contrast, the corre- 
sponding minimum distance, in accordance with the invention,' is less than -2". Specifically, it is V2. And note 
that, from a graphical perspective, subsets A and B overlap one another, as do subsets C and 0. (It is thus 
not possible to draw a box around the supersymbols, as was done in FIG. 4.) 
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Another Illustrative conslellatlon-this one having 64 symbols-Is shown In FIG. 9. Again, the constellation 
is partitioned Into four supersymbols labelled using the same labelling convention as that used for FIG. 7. 

FIGS. 10«14 show yet further constellations that can be used to advanlage'ln conjunction with the present 
Invention. The same labelling conventions are used and thus nothing further need be said about the conflg- 
5 uration of these constellations. 

The following two tables Illustrate the tremendous flexibility provided by the present invention in terms of 
providing unequal-error-protection signaling schemes which provide various different combinations of a) per- 
centage of most Important bits, b) degree of overall code redundancy, c) coding gains, and d) ratio of peak- 
to-average power (which Is an important consideration in power*Iimited channels such as terrestrial and sat- 
10 ellite telephone channels). TABLE 1 is a table of codes in which 25% of the bits constitute the most important 
bits. TABLE 2 is a table of codes in which various other percentages of the bits constitute the most important 
bits. 
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5 TABLE 1 



10 





Example^ 


Signal 
ConsteUatioQ 


Code Co for 
important bits 


CodeCi for less 
important bits 


15 


4A 

25% most imponani 
daca 
rate4-l/L 


Fig. 10 
P = 5/2,yAR « 1-7 

j 4. if.flA « cd 
1 I, dabbed 


[23.35J: 16. 
state, retell 
convolutional code 
<^'(Co) = 11 
r a 7.4 db 


single parity check 

code with 
redundancy 1/L 
rf'(C,) «2 

7 =» OdB 


20 
25 


4B 

25% most imporunt 
data 
faie4-2/L 


Fig. 7 

P = Z.<n,PAR a 1-7 

4. if £zA = cd 
3 , if ai e c5 
[ 1. if a/> a 


[6M]: 16- 
state; rate \/Z 
convolutional code 
dHCf^) = 14 
r« 7.6dB 


single parity check 

code oyer FF^ 
with redundancy 2/L 
rf*(C,)»4 
Y«2.l2dB 


30 


4C 

25% most important 
data 
rate4-l/L 


Fig. U 
P = 5.25. PAR = 1-7 

I 10. if 06 » cdf 
1 2. if ofr «fc cif 


(23J51:sc« 
Example 4 A 
</^Co) - 26 
r = 7.91 dB 


single parity check 

code with 
redundancy IfL 
rf'(C,) »4 

Y « 0.21 dB 


35 


4D 

25% most imporunt 
data 
mie4-2/L 


Hg.l2 

p = n./»xi? » 1-86 


single parity check 
code wicb 
redundancy \/L 
, rf^Co)-50 
r»7.54dB 


[23J5]: see 
Example 4 A 

parity check 
rf»(Co) = 14. 
ya 2.20dB 


40 ■ 
45 


4E 

25% most important 
data 


Fig. 9 

P (4 + 24x+l40;t^)/32 

if a6 = c5 
x*. if a6 e 
1, ilab^cd 
PAR » 2-05 for X » 0.3 


X r(dB) 
0.4 (23.351 4.92 
0.3 [23.35] 6.11 
0.2 [23.351 7.90 
0.1 (23.35] 10.10 


2-levelcode: see 
Example 4 D 

dHCo) « I4x^ 
£ 2(dB) 
0.4 3.96 
0.3 3.25 
0.2 1.91 
0.10-1.46 



50 



55 



10 



EP 0 540 231 A2 



5 

TABUS 2 



10 





Example 




Signal 


Code Co for 


^ CodcCi for less' 






ConsteUaooa 


unponant bits 


imponantbits 


IS 






Fig. 13 








4F 




10.5. PAR « 2-33 


(231J: 16- 


single parity check 




50% importanl 




state, niie 1/2 


code wuh 




data 




3. ira6 - cd 

2. if a& - c^rf 


convolutkxial code 


redundancy \/L 




tdicA-'UL 




rf*(Co) « 16 
r« 5.8dB 


d^iCi) B 8 
T"18dB 


20 






1. if o6 = erf 
















2*levd code: - 












[3U3] with 










20evel code: • 


puncturing nile 


25 


< • 






[52.66.76): 16-Jiaic 


[; ogive 


4G 






taxe 1/3 convolutional 




33% importanl 
daia 


Fig. 11 
P o 5.25. m = 1-7 


codcrf^ a 12 
A 


15-suie. rate 2/3 
codcdu a 5 
& 

parity chock 




ialc4-2/Z. 




sec Example 4C 


parity check 
d*(C«) " mine 12x2. 2x10) 
» 20 


30 








r a 6.8dB 


d'(C„ - 










min(5x8, 2x16. 64) « 32 
Y » 2.8dB 












2-levdcodc: - 


35 








2- level code: - 


rate 2/3 punctured 


4H 






[2335]: 16-sute 
raie 1/2 oonvotuiional 


convolutional code 
bom Example 4G 




ytM important 




Fig. 10 


code, dii N 7 


& 




data 


P o 


5.23. /-A* « 1-76 


& 


l6.siale,nue7/8 




nvtA-UL 




$ec Example 4C 


parity check 
<f'(Co) = min(7x2. 2x10) 


punctured convoiutio<ul . 
oodewiifarf^ a 3 


40 








« 14 
r - 5.3dB 


d^iCx) « 
min(40. 3x16. 64) » 40 
7» 3.76dB 
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TABLE2ConiU 



20 



30 



35 



Example 


Signal 
Constellation 


Code Co for 
impoctani biu 


Code C| for lesi 
imponant bits 


4J 

43.75% imponani 

daia 
m&4*\t4-2IL 


F!g.4 . 
F » 4.75. FAR = 1-9 

1 8. i/ 0^ a c2 
1 4. Uab^cd 


Mevelcode: . 
rate 3/4 oonvolutional 
code from Example 4F 
A. 

parity check 
rf^Co) - nuD(4x4. 2x8) 
« 16 . , 
r - 6.24 dB 


3'kvd code: • 
raie 1/2 coQvolutional 
code bon Example 4 A 
A. 

rate 3/4 eoovoludonal 
code 6om Example 4F 
& 

. parity chock- 
d\C^) - 7 
7 a 2.7dB 


4K 

5625% imponant 
. raie4-2//. 


Fig. 14 . 
/» « \6^,FAR a 1-63 

9. ife -7 
18. iffrc « ?7 
1 36. ifo6c - d£f 


3-Icvcl code: • 
raie l/2convo(udonal 
code bom Example 4A 

A ■ . . 
raie3MconvoludonaI 
code Crom Example 4P 

& 

parity check 
<i'(C«) a mb(&3. 72. 72) 
a 63 r a 6.73 dfl 


2-levd code; - 
rate 3/4 convolutional 
code txom Example 4F 

parity check 
rf'(C,) a 16 
, Y«0.78dB 


4L 

22.5% unporunt 

dau 
rate 7/8 
. (power penally) 
0.75 dB 


Fig. 12 
/» a u, />x^ ■ l-w 
'''(no. n,) a 25 


(23351 with 
puncxumg rule 
(1010011. llOOlO] 
to give 16-siaie 
rate 7/8 ooovobikxial 
code with tf/f ■ 3 
rf'(Co) a 75 
r a 8.55 dfl 


see Example 4D 
d*{C,) = 14 
7 a 1.27 dB 



In these tables, P denotes the average power per dimension: PAR denotes the peak-to-average power 
ratio; <fl denotes the square Euclidian distance between the supersymbols represented by its arguments; V 
denotes the nominal coding gain for the more important bHs; y denotes the nominal coding gain for the less 
important bits; and (g^^J is the generator matrix, in octal notation, for the convolutional codes indicated; L is 
the length of the parity check code. For non-uniform consteHatlons. the degree of non-uniformity Is determined 
by X. The tables also'.show the achievable gains as a function of x. 

In designing unequal error protectton signaling schemes, such as those just presented In TABLES 1 and 
2. one typically must first be given the values of certain parameters. These include (a) available channel band- 
width, (b) the worst-case channel SNR, (c) the number of classes of bits, (d) the percentage of bits In each 
dass. (e) the desired quality of the final received signal under the worst-case channel conditions, (I) acceptable 
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decoder complexity, and (g) peak-lo-averaga power ratio. One can then proceed to design an unequal-error- 
protection scheme consistent with the given parameter values. 

Typically, one might begin by choosing the signal constellation to allow foi^ about one overall bit of redun- 
dancy per symbol. The numberof supersymbols that Is needed Is determined by the actual number of important 
bits persymbol. For example, if more than 25%, and less than 50%, of the bits are important, and if the available 
bandwidth and required overall bit rate dictate, say. four information bits per symbol, then we wOl have to trans- 
mit one important bit per symbol. Assuming, further, that it is desired to provide some amount of redundancy 
for the important bits and that those bits will t)e used to select the supersymbols. then it may be reasonable 
to use a two-dimensional constellation having four supersymbols. Various of the constellations disclosed here- 
in, orany other desired constellation, can be used as the initial design choice. One would then proceed to select 
codings to be used for the bit streams depending on the relative redundancies desired to be allocated to them 
Importantly, the use of multi-level codes, i n accordance with the p resent invent ion^ can facilitate the attainment 
of the desired design criteria. If, upon analysis, It appears that the^eslred quality at the worst-case SNR Is 
not achieved with the design arrived at to this point, other constellations and other codes can be explored 
with a view toward seeing whether it can. In fact, be achieved. If this does not appear possible, one or more 
of the previously given constraints, such as acceptable decoder complexity, may have to be relaxed. Other 
design criteria are conceivable as well as other parameters that may affect the choice of the code design. 

In accordance with an advantageous technique for assigning the values of the bits that are used to select 
the symbols from each ideritifled supersymbol to those symbols, a pair of symbols from respective different 
supereymbols are assigned to the same less-important-bit values if the distance between that pair of symbols 
I is the minimum distance between any pair of symbols of those two supersymbols. Such a scheme is illusb-ated 
In FIG. 10. in which, like in FIG. 4, each symbol is labelled with a ba, bo set of values. Note, for example, 
that the symbols labelled 110 in each of the supersymbols fioo. ^01. flio and n„ all satisfy the aforementioned 
criterion. Such a iabeliing scheme-which is achievable to varying degrees, depending on the constellation and 
supereymbol geometries-is advantageous In thai it Improves the probability that the less-lmportanl-bit values 
will be decoded properly, even If an error is made in recovering the correct supersymbol sequence. Beyond 
this, it may be possible to achieve former benefit by similar judicious choice of bit assignments for those sym- 
bols which do not meet the above-mentioned minimum distance criterion. This would need to be done, however, 
within the constraints that are imposed by any coding that is implemented for the symbols within the super- 
symbol, as was, in fact, the case of the example described above in conjunction with the constellation of FIG. 
4. 

The foregoing merely illustrates the principles of the present invention. For example, although the illus- 
tratlve embodiments are Implemented using two data streams- the most- and less-important-lhe invention 
can be used In schemes which include three or more streams . Additionally, although two-dimensional constel- 
lations are shown, the invention can be used In schemes using constellations with more than two dimensions. 

It may also be noted that although the Invention is illusfrated herein as being implemented with discrete 
functional building blocks, e.g., source coders, scramblers, etc.. the functions of any one or more of those build- 
ing blocks can be carried out using one or more appropriate programmed processors, digital signal processing 
(DSP) chips, etc. 



Claims 

1. Apparatus for communicating information comprising 

means (104) for generating a digital signal representing the Information, the digital signal being 
comprised of at least first and second streams of data elements, 
CHARACTERIZED BY 

means (110. 111. 114, 115, 131) for channel mapping the digital signal in such a way that the prob- 
ability of channel-induced error for the data elements of the first data stream is less than the probability 
of channel-induced error for the data elements of the second data stream, said channel mapping means 
including means (114) for multi-level coding at least one of said streams, and 

means (141. 151) for transmitting the channel mapped signal over a communication channel. 

2. The Invention of claim 1 wherein said information is television signal information and wherein first stream 
of data represents television signal information that is more important than the television signal informa- 
tion represented by the data elements of said second stream. 

3. The invention of claim 1 wherein said at least one of said streams includes at least two substreams, and 
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wherein said multi-level coding means includes means (1141. 1142) for redundancy coding at least one 
of said substreams and for combining all of the redundancy coded substreams of said one stream and 
any of its substreams that are not redundancy coded to form a coded signal for use in the channel mao- 
pcng, {/. *^ 

The invention of dalm 3 wherein the channel mapping means selects a sequence of symbols from a ore- 
defined constellation to represent the data elements, the constellation being comprised of supersymbols 
the ^Inlmum distance between the symbols within at least one of the supersymbols being less than the 
maximum intra-subset distance for said constellation. as man me 

The invention of claim 4 wherein the minimum distance between the symbols of said at least one of the 
supersymbols to greater than the minimum distance between symbols of the constellation as a whole. 
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FIG. 5 
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FIG, 10 
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I Digital signals (from 101), such as digital television signals, are subjected to a source coding step (by 
104) followed by a channel mapping step (by 114 and 115). The source coding step causes the signal to 
be represented by first and second data streams (on 105, 106). The first stream cam'es data regarded as 
more important and the second can-ies data regarded as less Important. In the channel, mapping step, the 
mapping is such that the data elements of the various data streams have differing probabilities of being 
erroneously detected at the receiver. The channel mapping step includes at least one multi-level coding 
step. The signal constellations used In the channel mapping step are partitioned Into supersymbols. in 
which the distance between the symbols comprising at least ones of the supersymbols Is less than a 
parameter referred to as the maximum Intra-subset distance (MID). Additionally, In some constellations, 
the minimum distance between at least ones of the symbols of at least one of the supersymbols Is greater 
than the minimum distance between the symbols of the constellation as a whole while, again, still being 
less than the MID. The first data stream is used to identify a sequence of supersymbols, while the second 
data stream is used to select particular symbols from the identified supersymbols. 
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